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Described is a study concerned with the mode of 
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Kilpatrick (1969) indicated tnat increasing the 
ability of students to solve problems has 1 eng been ~ 
goal of mat- . _c- instruction- 'The conferee--, of t:.o 
Cambridge Conference on School mathematics stated tn o 
the solving of mathematics problems was going tc con- 
tinue to - -...portant in tne mathematics curriculum. 
Regarding tne preparation of textbooks for matfe..... „cs 



classes, t ' e conferees stooed ( Goals for School ?' 



V/ — — V- * 



.tics 






...problem materials snould be considered at less 
as important as the text proper; and it should .re 
at least half of the time and attention of the 
authors . 

This article is a report of a research study concerned 
with the mode of presentation of printed mathematical 
word probl- . The study's specific concern is the 



me Ur /er ~ty of British Columbia 
. ancoua r, B. C., Canada (July 1, 1970) 
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effect of presenting a pictorial representation of the 
problem situation. 

Riedesel (1969) included the following in his 

lisi/ oi aids in the improvement of problem solving: 

:..ake use of drawings and diagrams as a tech- 
nique to help pupils solve problems. This 
technique is ^helpful to pupils of all ability 
levels, it forces the child to consider the 
problem situation. 

Other educators have also stressed the importance of 
ut»in^ pic corral si us in probl em solving (Henderson 
and Pingry, 1953; -^locm and Broder, 195C; Young, 1968; 
TruebloocL, 1969). 



./: ith 



resnect 



to the use of a pictorial repre- 



sentation, Bloom and Broder (1950) suggested tne fol- 



lowing: 

1. Don't let the physical format confuse the 
students. 

if you use diagrams use them correctly. 

5- arrangement of the data can distract from 
the meaning of the problem. 

•9. Indicate clearly how tne questions are to 
be answered. 

Young (1963), against the purposeful introduction 
of error into a problem solving situation, made the 
following statement: 



iieat, orderly work is always helpful, and figures 
drawn at least fairly accurately are often sug- 
gestive. ° 



It is well not to try to correct 
of an error discovered, but work 



the consequences 
afresh. 



Brownell (1951), in his general discussion of 

problem solving, suggested the following;*. 

Part of the real experience in problem solving 
is the ability to differentiate between the 
reasonable and the absurd, the logical and the 
illogical. Instead of being 'protected 1 from 
error, the child should many times be exposed 
to error and be encouraged to detect and demon- 
strate what is wrong, and why. 

Bigge (1964), in agreement with Brownell, wanted 

mistakes to be used to advantage. Bigge (1964) made 

the following comment about mistakes: 

making mistakes often encourages us to re-examine 
something we had regarded as true. Teachers 
usually do not let students make enough mistakes. 

The preceding discussion indicates the existence 
of an area of disagreement with respect co the use and 
accuracy of pictorial representations of problem situ- 
ations. 



Methods 



A testing instrument was developed to gather 
data which would support or reject the contention that 
subjects' achievement in solving printed mathematical 
word problems is affected by the presence of a pictorial 



representation of the problem situation, regardless 
the accuracy of the pictorial representation. 



of 
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Test Development 



Forty problems were selected from the Y- and Z- 
population test batteries of the Rational Longitudinal 
Study of mathematical Abilities (i\LSAA) and three mathe- 
matical textbooks (Dolciani, Berman, and Freilich, 1962; 
Jurgensen, Donnelly, and Dolciani, 196p; Vannatta, 
Goody/in, and Fawcect, 1962) on tne basis of the following 
two criteria: 



.•.the problems could be solved without a 
pictorial representation of the problem situation 
...the problems could be solved even if the 
pictorial representation of the problem situation were 
distorted. 



A pilot study was conducted to determine if the 
administrative procedures would work in one fifty-five 
minute class, to find the twenty problems that discriminated 
best, and to improve the sets of distractors. The twenty 
problems that discriminated best were then used to con- 
struct three forms of the final testing instrument. 

Form A of the final testing instrument contained 
only the prose description of the problem situations, 
each with five distractors. Form B contained an accurate 
pictorial representation for each item, in addition 
to the same information included in Form A. Form C 
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contained a distorted pictorial representation for each 
item, in addition to the sake information included in 
Form A. 



For each item there was a set of five distractors 
In each set of cistractors there was one called the 



"distorted answer". *he distorted answer was a; he choice 
that would have been correct had the distorted pictorial 
representations presented in Form C been correct. 

Figure 1 contains an example problem from the 
final testing instrument. 



Insert Figure 1 about here 



Admin i s t r at i on 



The test was administered early in the fall 
semester of the school year to 522 tenth grade students. 
The tests were administered in the students* usual mathe- 
matics classrooms by the students' regular mathematics 
teachers. The test booklets, were arranged in random 

order using a table of random numbers and distributed 
to the students in the students ' ordinary seating 

arrangement. 

The teachers we re directed to answer questions 
of a mechanical nature, i. e., questions concerning 



tne 



snarpening of the provided, pencils, typographical 
errors taut might oe found, etc. file subjects v/ere 
not told that the pictorial representations in Form C 
V; ere oistorted. -'-t tne close of the testing period and 
in the next crass period the teachers answered any 
questions the students had concerning the testing 
period. 



Background Material 



Junior 

natics 

order 



Reading scores (California Achievement Test), 
scores (California Mental Maturity Test for 
High School), and grades in ninth grade raathe- 
courses were collected for each student in 
uO test tiie effect of the variables on achieve- 



ment. 



results 



The results are divided into two main sections: 
(1) test analysis and (2) test of the hypotheses. 

Test Analysis 



The 



means, standard deviations, and reliability 



coefficients 



01 



the 



three forms of the testing instru- 



ment are presenter in Table 1. 



Insert Table 1 about here 



There were 114 subjects in Group A, the group 
that was administered Form A; 96 subjects in Group E, 
the group that was administered Form B; 112 subjects 
in Group C, the group that was administered Form C. 
Table 2 contains the dara •chat represent the perform- 
ances of each group on each item, as well as how many 
times Group C chose the distorted answer. 

Insert Table 2 about here 

Due to the differences in the size of each group 
it is useful to compare the percentage correct for each 
group on each item. Table 3 contains the means and 
adjusted means in percentage form for each group on 
each item. In Table 3 one will also find the number of. 
non-answers for each item. 

Insert Table 3 about here 

The data in Table 3 show that Group B scored 
higher on all the items except 4, 12, and 15. Group C 
nad the lowest percentage on all the items except 2, 6, 
9, 12, and 18. Cn twelve of the twenty items Group B*s 



percentage was at least twice Group C's percentage. 
Again referring to Table 3 , one notices that on only 
one item, item 12, was Group C's percentage greater 
than Group B's percentage and the difference v/as 1.0 
percent. 

The data in Table 3 also show rh&t the subjects 
in Group C favored the distorted answer over the cor- 
rect answer on all items except 4-, 3 > 6, and 13 • On 
only five items did over 25% of Group C choose the 
correct answer while for fifteen items over 23 % of 
Groun C chose the distorted answer, and for five of 

-L. * 

those fifteen items over 50% of Group C chose the dis- 
torted answer. 



Test of the Hypotheses 



The study tested two hypotheses: 

1. The subjects' achievement in solving printed 
mathematical word problems is affected by the presence 
of a pictorial representation of the problem situation, 
regardless ;,f the accuracy of the pictorial representa- 
tion. 

2. The subjects' achievement in sclving printed 
mathematical word problems is affected by I. Q. scores, 
reading scores, and grade averages in the preceding 



year's mathematics courses, regardless of the method 
used to present the mathematics word problems. 

To test the first hypothesis the means of the 
three groups were tested by analysis of variance. The 
analysis can be found in Table 4. 



Insert Table 4 about here 



The source of the variance, indicated by the 
significant E-ratio in Table 4, v/as determined by 
applying a modification of Duncan's hew Iviultiple Range 
Test. The modified version is one, developed by Kramer 
(1956), which is appropriate with unequal cell size,. 

The final ranking showed that Group B's performance 
was significantly higher than Group A's performance 
and Group A's performance was significantly higher 
than Group C's performance. The level of significance 
was . 005 • 

The second hypothesis v/as tested using double 
classification analysis of variance. Table 5 contains 
the test of the means when the three groups were divided 
according to I. Q. scores. Figure 2 is a graphical 
re-presentation of the means of the three groups divided 
according to I. scores. I. Q. scores were available 
for 236 of the 322 subjects in the study. The average 
I. Q. v/as 108. 



Insert Table 5 and Figure 2 about here 

*-••*> — to* «M — — — to* •** **• «** to* to* to* to* to- *to to* aw toto to* to* «** to. to* to- m# **. **> to* *to •*• to* 

Table 6 contains the comparison oi the means 
when the three groups were divided according to read- 
ing scores. Figure 3 is a graphical representation 
of the means of the three groups divided according to 
reading scores. Reading scores were available for 
244 of the 522 subjects. The average reading score 
was 10*1. 

MB — — “ **** §mm ^ ^ “ *** *** "*• ^ ^ **• ~ “*• ^ •** ~ ^ ^ ^ ^ •• «•» W M M aLV BM 

Insert Table 6 and Figure 3 about here 

Tne ceso oi une means wnen tne three groups were 
divided according to grade averages in the preceding 
year’s mathematics courses is presented in Table 7* 
Figure 4 is a graphical representation of the means of 
the tnree groups divided according to grade average in 
the preceding year’s mathematics courses. A complete 
set of grades was available for 249 of the 322 subjects 

Insert Table 7 and Figure 4 about here 

In all three applications of double classifica- 
tion analysis of variance significant main effects were 
noted. The data supported both hypotheses. 

The data support the conjectures that the pre- 
sentation of an accurate pictorial representation of 



the problem situation facilitates student achievement 
and the presentation of a distorted pictorial representa- 
tion of the problem situation debilitates student achieve- 
ment, The subjects’ I. scores, reading scores, and 
grade averages in the preceding year’s mathematics 
courses were related to the subjects’ achievement, 
regardless of the method used to present the word 
problems. 

In all three applications of double classification 
analysis of variance significant interaction effects 
were noted. The ordinal interaction effects demonstrated 
that the variables had more effect in the high I. Q* 
group than the other two I. groups. However, the 
ranking of the groups v/as not altered. Equivalent 
results were obtained for the reading and grade average 
groups. 



Discussion 



The results discussed in 



interpreted in the light of 



the last section must 
the fact that the stu- 



dents were in a testing s 
be taken in transferring 



it nation. Great care must 
the information obtained to 



C-I 



mce e< 



of the problems could be 
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the classroom 
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solved without a pictorial represen o&tion, the data 
seem to show that the subjects tended to place emphasis 
on the pictorial representation rather than the prose 
description of the problem situation. 

Since students, at least in a testing situation, 
tend to assume tne information presented is correct, 
the teachers should emphasize, as some educators have 
advocated (Brownell, 1951; Bigge , 1964), that separat- 
ing the logical from the illogical is part of solving- 
problems. 

-j?ns effect of presenting the distortion in a 
testing situation was so strong that the high reading 
group taking Form C scored lower than the low reading 
group taking either Perm A or Form 3. -An equivalent 
result was obtained for the grade average variable. 

The effect of presenting an accurate pictorial 
representation as an aid in a testing situation was so 
strong that the low grade average group taking Form 3 



scored higher than any grade average group taking 
either of the other two forms. 
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is 


24 and 


the length of 


a minor arc is 4. 




\ ‘ i’Vi 0 -f- 


as tne measure 


(in degrees) of the central 


ans 


le fcr-i: 


:ied by the two 


radii v/nich intersect the 


circle no 


form she arc? 




(A) 


24 






(5) 


30 






(C) 


43 






(») 


60 






(3) 


90 


Form B* 


Form C* 





*?orm A contained only tne prose description oi the problem 
situation and she five distracsors. Form B contained the 
same information as Form A, in acuision to 



7-50 : 



picsorial 






— C 



resentation on the left. Form C contained the same 



information as Form A, in addition to the pictorial 
representation on the 



ngnt . 



Figure 1 
Example Problem 
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Total Test Leans, Standard Deviations, and 
Reliability Coefficients 



2'or& 


Lean 


Standard 

Deviation 


Crcnbach’s 

Alpha 


A 


4.94 


2.12 


.40 


3 


8.56 


3.31 


.70 


C 


3.79 


2.13 


.53 



o 



TABLE 2 



Comparison of the Performances of the 
Subjects of All the Groups 



0 5iii 



Number Choosing 
Correct Answer 
ABC 



Number Choosing 
Distorted Ansv/er 

C 



1 


19 


21 


9 


54- 


2 


22 


32 


30 


52 


3 


31 


83 


22 


75 


4 


19 


14 


13 


11 


c 


63 


61 


64 


6 


6 


20 


23 


24 


15 


7 


18 


71 


4 


91 


3 


19 


36 


6 


61 


9 


36 


31 


41 


51 


10 


24 


41 


3 


49 


11 


, 32 


42 


20 


58 


12 


4-9 


31 


37 


52 


13 


12 


22 


8 


31 


14 


33 


57 


33 


39 


13 


20 


13 


13 


9 


16 


48 


56 


27 


29 


17 


16 


42 


15 


30 


13 


13 


4-7 


21 


4-5 


19 


22 


26 


11 


33 


20 


21 


20 


16 


17 



o 

ERIC 



TABLE 3 

Item Analysis: Keans, Adjusted Keans, 

Number Not Answered 





1— 


e a n 




A a 


3 u s 


ted 


No 


Answer 


X"u 8 in 


F 


0 r m 






Jl e a 


n 


“n 
















For 


m 


fi 


0 r 


m 






B 


C 


A 


B 


C 


A 


B 


C 


1 


17.5* 


22.1* 


8.2* 


17.3* 


22 . r 


* 8.3* 


0 


0 


1 


2 


20.0 


53.7 


27.3 


20.0 


34.0 


27.3 


0 


]_ 


0 


-7 

y 


23.2 


89.5 


20.0 


28.2 


39.5 


20.0 


0 


. 0 


0 


4 


17.5 


14.7 


11.8 


17.4 


14.9 


11.8 


1 


1 


0 


5 


59.1 


64.2 


58.2 


59.8 


64.9 


53.7 


1 


1 


1 


6 


IS. 2 


26.3 


21.8 


18. 7 


26.3 


22.0 


3 


0 


1 


7 


16.4 


74.7 


3.6 


16.4 


74.7 


3.6 


0 


0 


0 


O 


17.5 


53.9 


5.5 


17.4 


58.9 


5.5 


1 


0 


0 


9 


32.7 


53.7 


37.3 


32.7 


53.7 


37.3 


0 


0 


0 . 


1C 


21.3 


43.2 


2.7 


21.8 


43.6 


2.7 


0 


-1 

J. 


0 


—s 


29.1 


44.2 


18.2 


29.4 


44.2 


18.2 


1 

mlm 


0 


0 


12 


44.3 


32.6 


33.6 


45.4 


32.6 


33.6 


2 


0 


0 


15 


10.9 


23.2 


7.3 


11.1 


23.4 


7.3 


2 


1 


0 


14 


31.8 


60.0 


30.0 


32.1 


60.0 


30.0 


1 


0 


0 


15 


18.2 


13.7 


11.8 


19.2 


13.8 


11.9 


6 


1 


1 


16 


43.6 


53.9 


24.5 


45.7 


53.9 


24.5 


5 


0 


0 


17 


14.5 


44.2 


13.6 


15.4 


45.2 


13.6 


6 


2 


0 


13 


13.6 


49*5 


19.1 


14.4 


50.0 


19.1 


6 


T 

-i- 


0 


19 


20.0 


27.4 


10.0 


21.4 


27.7 


10.0 


7 




0 


20 


19.1 


21.1 


14.5 


20.4 


21.7 


15.0 


7 


5 


3 



Total Number 
lot Answered: 



49 13 7 



* •T , V 



The numbers in these columns are percentages. 
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Comparison of txie Group Means: 
Analysis of Variance fable 



Source 


Mean Square 


Gf 


F-r&tio 


Total 


11.37 


321 




Groups 


612.64 


2 


80.62* 


Error 


■ 7.60 


319 





*p ^ *005 



o 



TaBLE 5 



Comparison of the Means 
-he Groups are Divided by I. 



When 

Q. Scores 



Source 


Mean Square 


df 


F-ratio 




Total 


11.52 


226 


* 




Between 


175.69 


8 






Group 


502.55 


2 


90.25* 




I. Q. 


135.35 


2 


24.30* 




Group X I. Q. 


28.43 


4 


5.11* 


* 


Error 


5.57 


218 







*p < .005 



» 




levels of I. Q. 



Figure 2 

Achievement; as a Function of 
'Group Membership and I« Q> 
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TASKS 6 



Comnarison of the Keans When the '^oups 

4 . •** 

Are Divided By Reading Scores 



Source 


Kean Square 


df 


F-ratio 


Total 


11.33 


236 


• 


Between 


165.70 


8 




Groups 


466.07 


2 


78.80* 


Reading 


134.91 


2 


22.81* 


. Groups X Reading 30.91 


4 


5.23* 


Error 


3.91 


228 





*p < .005 
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« Group B 
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/ 






/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



Group A 



/ 



/ 



/ 



/ 



' * Group C 



2 - 
1 - 

V 1 1 1 M ~ “ ’ w ” * " 

Low Middle High 

Levels of Reading 

Figure 3 

Achievement as a Function. ox 
Group Membership and Reading 
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Comparison of the Leans ‘//hen the Groups 
Are Divided By Gj>ade Average 



Source 


Lean Square 


di 


F-ratio 


Total 


11.34 


241 


- 


Between 


146*82 . 


8 




Groans 

JL. 


461 . 86 


2 


69.08* 


Grades 


74.27 


2 


11.11* 


Group Z 


Grades 2p.p6 


4 


3.82* 


Frror 


6.69 


233 





*p < .005 
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lO 



s 

c 

o 

r 

e 

s 



9 J 



8* 



7 

6H 



5i 



4- 



■3' 

2 



1- 






4 Group B 



/ 



/ 


















/ 



/ 






/ 



Group A 






a Group C 



Low 



Middle 



High 



.evels of Grade Average 



Figure 4 



Achievement as a Funcuioii of Group 
Nembersliip and Grade Average 
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